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Specification 
Title of the Invention 
Pattern Collation Apparatus 

5 Background of the Invention 

The present invention relates to a pattern 
collation apparatus which collates a registration 
pattern with a collation pattern. 

There is conventionally a pattern collation 

10 apparatus which employs a collation algorithm called a 
correlation method based on cross correlation between a 
registration pattern and a collation pattern. 

This pattern collation apparatus executes 
two-dimensional discrete Fourier transform for a 

15 two-dimensional collation pattern to create collation 
Fourier pattern data. The collation Fourier pattern 
data is synthesized with the registration Fourier 
pattern data of a registration pattern, which is created 
by the same processing as that for the collation Fourier 

20 pattern data. Two-dimensional discrete Fourier 

transform (or two-dimensional discrete inverse Fourier 
transform) is executed for the synthesized Fourier 
pattern data. The coincidence/incoincidence between the 
collation pattern and the registration pattern is 

25 determined on the basis of a correlation value obtained 
from the synthesized pattern data (correlation pattern 
data) that has undergone two-dimensional discrete 
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Fourier transform (or two-dimensional discrete inverse 
Fourier transform) . 

The present applicant has proposed before a 
pattern collation apparatus which collates N-dimensional 
5 patters [e.g., voiceprints (one-dimensional), 

fingerprints (two-dimensional), and stereoscopic 
patterns (three-dimensional)] on the basis of frequency 
characteristics or spatial frequency characteristics 
(Japanese Patent Laid-Open No. 9-22406 (reference 1)). 

10 In reference 1, a kind of amplitude 

suppression processing (e.g., log processing) is 
executed for a synthesized Fourier pattern in a spatial 
frequency space. In addition, mention is made of a 
"phase only correlation method" in which a collation 

15 result is obtained by calculating the correlation value 
between a registration pattern and a collation pattern 
on the basis of only the phase components of Fourier 
pattern data that is obtained by executing Fourier 
transform for the registration and collation patterns. 

20 In addition to the above -described correlation 

method, a scheme called a feature point method is also 
used. In this feature point method, the feature points 
(e.g., an end point at an end of a fingerprint pattern, 
a branch point at a branch of the pattern, or a corner 

25 of a graphic pattern) of two patterns to be collated are 
extracted. The coincidence/incoincidence between the 
collation pattern and the registration pattern is 
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determined on the basis of feature parameters that 
represent the microscopic feature point information 
(e.g., the positions, directions, and types of the 
feature points) (Japanese Patent Laid-Open No. 7-57084 
5 (reference 2) and Japanese Patent Laid-Open No. 1-211184 
(reference 3 ) ) . 

The correlation method and, particularly, the 
amplitude suppression correlation method including the 
above -described phase only correlation method is 

10 resistant against the influence of changes in 

environment such as illuminance in inputting a collation 
pattern to the collation apparatus or the influence of 
the positional shift between a registration pattern and 
a collation pattern and has a very high collation 

15 accuracy, as compared to the feature point method that 
is used as a general collation algorithm. 

For example, when the amplitude suppression 
correlation method is used for fingerprint collation, 
accurate collation can be done even if the image quality 

20 of a registration fingerprint or collation fingerprint 
is poor due to a dry or wet finger or chappy skin. 
Figs. 30A and 30B show the images of registration and 
collation fingerprints of a person who has chappy skin 
and therefore exhibits distorted patterns. Even in this 

25 case, since the amplitude suppression correlation method 
executes collation on the basis of spatial frequency 
characteristics, the coincidence/incoincidence between 
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the two fingerprints can be determined. In the feature 
point method, however, since no end point or branch 
point can be extracted, it is difficult to determine the 
coincidence/incoincidence between the two fingerprints. 
5 However, recent experiments indicate that 

patterns of a certain type can correctly be collated by 
the feature point method but not by the amplitude 
suppression correlation method. For example, assume 
that a registration fingerprint is properly obtained, as 

10 shown in Fig. 31A, and a collation fingerprint is 

obtained at only the fingertip, as shown in Fig. 3 IB. 
In the fingerprint of only the fingertip, the pattern is 
distorted. For this reason, the amplitude suppression 
correlation method may be unable to determine the 

15 coincidence/incoincidence between the two fingerprints. 
To the contrary, the feature point method can extract an 
end point or branch point even from the fingerprint of 
only the fingertip. Hence, the 

coincidence/incoincidence between two fingerprints can 

20 be determined. 

Summary of the Invention 

It is an object of the present invention to 
provide a pattern collation apparatus which combines 
collation methods of different types, i.e., the 

25 correlation method and the feature point method to 

compensate for their disadvantages and obtains a much 
higher collation accuracy than an apparatus which 
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executes a single method. 

In order to achieve the above object, 
according to the present invention, there is provided a 
pattern collation apparatus for collating a registration 
5 pattern with a collation pattern, comprising first 
collation means for executing collation between the 
registration pattern and the collation pattern on the 
basis of a correlation value between the patterns, 
second collation means for executing collation between 

10 the registration pattern and the collation pattern on 

the basis of a feature parameter defined in advance, and 
collation determination means for determining that the 
registration pattern coincides with the collation 
pattern by using at least one of a collation result by 

15 the first collation means and a collation result by the 
second collation means . 
Brief description of the Drawings 

Fig. 1 is a block diagram of a fingerprint 
collation apparatus according to an embodiment of the 

20 present invention; 

Fig. 2 is a flow chart for explaining a 
fingerprint registration operation in the fingerprint 
collation apparatus; 

Fig. 3 is a flow chart showing processing for 

25 calculating the area and image quality value of a 

registration fingerprint in the flow chart shown in 
Fig. 2; 
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Figs . 4A and 4B are views showing photos on a 
display, which indicate fingerprint images and 
ridge -direction block images obtained from the 
fingerprint images ; 
5 Fig. 5 is a flow chart for explaining a 

fingerprint collation operation (collection method (1)) 
of the fingerprint collation apparatus; 

Figs . 6A to 6H are views showing photos on a 
display so as to explain the fingerprint collation 
10 process of the fingerprint collation apparatus; 

Fig. 7 is a graph showing the ROC curves of 
the amplitude suppression correlation method 
(characteristic I), the feature point method 
(characteristic II), and a combined method of the 
15 amplitude suppression correlation method and feature 
point method (characteristic III: a method of the 
present invention) ; 

Fig. 8 is a bar graph showing the EERs of the 
methods, which are obtained from the ROC curves; 
20 Fig. 9 is a functional block diagram 

corresponding to collation processing (collation method 
(1)) executed in accordance with the flow chart shown in 
Fig. 5; 

Fig. 10 is a flow chart for explaining another 
25 fingerprint collation operation (collection method (2)) 
of the fingerprint collation apparatus; 

Fig. 11 is a functional block diagram 
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corresponding to collation processing (collation method 

(2) ) executed in accordance with the flow chart shown in 
Fig. 10; 

Fig. 12 is a flow chart for explaining still 
5 another fingerprint collation operation (collection 
method (3)) of the fingerprint collation apparatus; 

Fig. 13 is a functional block diagram 
corresponding to collation processing (collation method 

(3) ) executed in accordance with the flow chart shown in 
10 Fig. 12; 

Fig. 14 is a functional block diagram that 
employs a collation method (4); 

Fig. 15 is a flow chart for explaining still 
another fingerprint collation operation (collection 
15 method (5)) of the fingerprint collation apparatus; 

Fig. 16 is a functional block diagram 
corresponding to collation processing (collation method 
(5)) executed in accordance with the flow chart shown in 
Fig. 15; 

20 Fig. 17 is a flow chart of processing in which 

processing necessary for collation by the correlation 
method and processing necessary for collation by the 
feature point method are executed for the original image 
data of a registration fingerprint at the time of 

25 registration to prepare registration data for the 

correlation method and registration data for the feature 
point method and obtain their scores; 
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Fig. 18 is a flow chart for explaining a 
fingerprint registration operation according to the 
second embodiment; 

Figs. 19A and 19B are views for explaining 
5 transformation from a Cartesian coordinate system to a 
polar coordinate system; 

Fig. 20 is a flow chart for explaining a 
fingerprint collation operation according to the second 
embodiment ; 

10 Figs. 21A to 21G are views for explaining a 

coarse collation process according to the second 
embodiment ; 

Fig. 22 is a flow chart showing processing 
contents (first collation) in step S711 shown in 

15 Fig. 20; 

Fig. 23 is a flow chart showing processing 
contents (second collation) in step S712 shown in 
Fig. 20; 

Figs. 24A to 24H are views showing photos on a 
20 display, which indicate images so as to explain 

processing after polar coordinate transformation in the 
coarse collation process (first collation); 

Figs. 25A to 25H are views showing photos on a 
display, which indicate images so as to explain a fine 
25 collation process (second collation) according to the 
second embodiment ; 

Fig. 26 is a flow chart for explaining a 
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collation (third collation) operation by the feature 
point method according to the second embodiment; 

Fig. 27 is a flow chart for explaining a 
fingerprint collation operation according to the third 
5 embodiment ; 

Fig. 28 is a flow chart for explaining a 
fingerprint collation operation according to the fourth 
embodiment ; 

Figs. 29A to 29G are views showing photos on a 
10 display, which indicate images so as to explain a coarse 
collation (first collation) process according to the 
fourth embodiment; 

Figs. 30A and 30B are views showing photos on 
a display, which indicate the images of registration and 
15 collation fingerprints of a person who has chappy skin 
with distorted patterns; and 

Figs. 31A and 31B are views showing photos on 
a display, which indicate the images of registration and 
collation fingerprints which can correctly be collated 
20 by the feature point method but not by the amplitude 
suppression correlation method. 
Description of the Preferred Embodiments 

The present invention will be described below 
in detail with reference to the accompanying drawings. 
25 [First Embodiment] 

Fig. 1 shows a fingerprint collation apparatus 
according to an embodiment of the present invention. 
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Referring to Fig. 1, reference numeral 10 denotes an 
operation unit; and 20, a control unit. The operation 
unit 10 has a ten-key pad 10-1, display (LCD) 10-2, and 
fingerprint sensor 10-3. The fingerprint sensor 10-3 
5 has a light source 10-31, prism 10-32, and CCD camera 
10-33. The control unit 20 comprises a control section 
20-1 with a CPU, ROM 20-2, RAM 20-3, hard disk (HD) 
20-4, frame memory (FM) 20-5, external connection 
section (I/F) 20-6, and Fourier transform section (FFT) 

10 20-7. The ROM 20-2 stores a registration program and a 
collation program. 
[Fingerprint Registration] 

In this fingerprint collation apparatus, a 
user's fingerprint (to be referred to as a registration 

15 fingerprint hereinafter) to be used as a registration 

pattern is registered in the following way. Before the 
operation, the user inputs the ID number assigned to 
him/her by using the ten-key pad 10-1 (step S101 in 
Fig. 2) and places a finger on the prism 10-32 of the 

20 fingerprint sensor 10-3. The prism 10-32 is irradiated 
with light from the light source 10-31. The light from 
the light source 10-31 is totally reflected by recess 
portions (valley portions) of the skin surface, which do 
not come into contact with the surface of the prism 

25 10-32, and arrives at the CCD camera 10-33. Inversely, 
the total reflection condition is not satisfied at the 
projecting portions (ridge portions) of the skin 
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surface, which come into contact with the surface of the 
prism 10-32, so that the light from the light source 
10-31 scatters. For these reasons, a pattern with 
contrast, i.e., a fingerprint pattern having bright 
5 valley portions and dark ridge portions is sampled. The 
pattern of the sampled fingerprint (registration 
fingerprint) is A/D-converted into a halftone image 
(image data: two-dimensional pattern data) having, e.g., 
512 X 512 pixels and 256 gray levels and supplied to 

10 the control unit 20. 

The control section 20-1 causes the frame 
memory 20-5 to capture the image data of the 
registration fingerprint supplied from the operation 
unit 10 (step S102) and calculates an area S and image 

15 quality value Q of the captured registration fingerprint 
(step S103). The calculation processing of the area S 
and image quality value Q is executed in accordance with 
the flow chart shown in Fig. 3. 

The control section 20-1 extracts the boundary 

20 between a region where the fingerprint pattern is 

present and a region where no pattern is present from 
the captured registration fingerprint and calculates the 
number of pixels of the registration fingerprint, 
including the boundary, as the area S (step S201). In 

25 addition, the image of the registration fingerprint 

having 512 X 512 pixels is segmented into blocks each 
having 8X8 pixels. The blocks are binarized (step 
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S202) to calculate the ridge direction (eight 
directions) in each block (step S203). The continuity 
of the ridge directions between the blocks is evaluated 
to obtain an evaluation value (step S204). The 
5 evaluation value is normalized by the area S to obtain 
the image quality value Q (step S205). The image 
quality value Q takes a value ranging from 0 to 1 . The 
larger the image quality value Q is, the poorer the 
image quality is . 

10 Figs. 4A and 4B show fingerprint images and 

ridge -direction block images obtained from the 
fingerprint images. Fig. 4A shows a fingerprint image 
and a ridge-direction block image when the image quality 
value Q is 0.13. Fig. 4B shows a fingerprint image and 

15 a ridge -direct ion block image when the image quality 

value Q is 0.52. Fig. 4B shows a fingerprint image of a 
person who has chappy skin with distorted patterns. 
Since the continuity of ridge directions is poor, the 
image quality value becomes large. 

20 The control section 20-1 thus calculates the 

area S and image quality value Q of the captured 
registration fingerprint and then compares the 
calculated area S with a predetermined threshold value 
Sth (step S104). When S ^ Sth, the control section 

25 20-1 determines that the area of the fingerprint is 
small. The flow returns to step S102 to capture the 
image of the registration fingerprint again. Then, the 
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processing from step S103 is repeated. When S > Sth, 
the control section 20-1 determines that the area of the 
fingerprint is sufficiently large. The flow advances to 
step S105. 

5 In step S105, the number of captured images is 

checked. The operation from step S102 is repeated until 
the number of captured images reaches N. In this way, 
the control section 20-1 collects N registration 
fingerprint images whose area S exceeds Sth (YES in step 

10 S105) and selects an image whose image quality value Q 
indicates the highest quality from the N registration 
fingerprint images (step S106). A file of the selected 
registration fingerprint image data is created in the 
hard disk 20-4 as original image data to be used as a 

15 registration pattern in correspondence with the ID 
number (step S107). 

[Fingerprint Collation: Collation Method (1) 
(Correlation Method (Amplitude Suppression Correlation 
Method) + Feature Point Method)] 

20 This fingerprint collation apparatus collates 

a user's fingerprint in the following way. During the 
operation, the user inputs the ID number assigned to 
him/her by using the ten-key pad 10-1 (step S301 in 
Fig. 5) and places a finger on the prism 10-32 of the 

25 fingerprint sensor 10-3. The pattern of a fingerprint 
(collation fingerprint) to be used as a collation 
pattern is sampled, as in fingerprint registration. The 
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pattern is converted into a halftone image (image data: 
two-dimensional pattern data) having 512 X 512 pixels 
and 256 gray levels and supplied to the control unit 20. 
[Correlation Method (Amplitude Suppression Correlation 
5 Method)] 

Upon receiving the ID number through the 
ten-key pad 10-1, the control section 20-1 reads out the 
original image data of a registration fingerprint 
corresponding to the ID number from the files of 

10 registration fingerprint image data in the hard disk 

20-4 (step S302). Reduction processing is executed for 
the readout original image data of the registration 
fingerprint (step S303). The reduction processing is 
done by thinning out the pixel lines of the original 

15 image data having 512 X 512 pixels and 256 gray levels 
at a predetermined pixel pitch in the x direction 
(horizontal direction) and y direction (vertical 
direction). For example, pixel lines are thinned out 
every four pixels in the x and y directions to obtain 

20 reduced data having 128 X 128 pixels. 

The control section 20-1 sends the reduced 
registration fingerprint image data (Fig. 6A) to the 
Fourier transform section 20-7. The registration 
fingerprint image data is subjected to two-dimensional 

25 discrete Fourier transform (DFT) (step S304). With this 
processing, the registration fingerprint image data 
shown in Fig. 6A changes to Fourier image data 
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(registration Fourier image data) shown in Fig. 6B. 

The control section 20-1 also receives the 
collation fingerprint image data supplied from the 
operation unit 10 through the frame memory 20-5 (step 
5 S305). The received collation fingerprint image data is 
also subjected to the same reduction processing as in 
step S303 (step S306). 

The control section 20-1 sends the reduced 
collation fingerprint image data (Fig. 6E) to the 

10 Fourier transform section 20-7. The collation 

fingerprint image data is subjected to two-dimensional 
discrete Fourier transform (DFT) (step S307). With this 
processing, the collation fingerprint image data shown 
in Fig. 6E changes to Fourier image data (collation 

15 Fourier image data) shown in Fig. 6F. 

Note that the two-dimensional discrete Fourier 
transform is described in "Introduction to Computer 
Image Processing", edited by Nihon Kogyo Gijutsu Center, 
published by Souken Shuppan, pp. 44-45 (reference 4). 

20 Next, the control section 20-1 synthesizes the 

Fourier image data of the collation fingerprint obtained 
in step S307 and the Fourier image data of the 
registration fingerprint obtained in step S304 (step 
S308) to obtain synthesized Fourier image data. 

25 Let A • exp( j 9 ) be the Fourier image data of 

the collation fingerprint, and B*exp(j<f>) be the 
Fourier image data of the registration fingerprint. The 
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synthesized Fourier image data is given by A • B • 
exp(j(0 - <t> ) ) that is obtained by multiplying the 
Fourier image data of the collation fingerprint by the 
complex conjugate of the Fourier image data of the 
5 registration fingerprint, where A, B, 0 , and (f> are 
functions of the spatial frequency (Fourier) space 
(u,v) . 

A • B • exp(j( 6 -</>)) can be written to 
A • B • exp ( 3 ( 0 - <f> ) ) 

10 = A-B-cos(fl - 0) + j*A*B*sin(0 - <f> ) . . . ( 1) 

When A-exp(j0) = + j j3 x and B-exp(j<£>) = « 2 + j/3 2 , A 
= (a* + ^V' 2 . B = (a/ + & 2 2 ) U2 , 0 = tan^/a^ and <t> 
= tan *( j3 2 / o; 2 ) . The synthesized Fourier image data is 
obtained by calculating equation (1). 

15 Note that the synthesized Fourier image data 

may be obtained by calculating A • B * exp(j( 0 - (£> ) ) = 
A • B • exp ( j Q ) • exp ( - j <fr ) = A ■ exp ( j 0 ) • B • exp ( - j (f> ) = ( a 
+ J^) • ( 0f 2 - jj3 2 ) = ( a a • a 2 + & x m & 2 ) + J( a 2 ' " a i ' 
0 a ). 

20 After obtaining the synthesized Fourier image 

data, the control section 20-1 executes amplitude 
suppression processing (step S309). In this embodiment, 
log processing is executed as amplitude suppression 
processing. More specifically, the log of the amplitude 

25 A • B in A*B*exp(j(# - (f> ) ) described above, i.e., the 
arithmetic expression of the synthesized Fourier image 
data, is calculated as log( A • B) • exp( j ( 9 - <f> ) ) , 
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thereby suppressing the amplitude A • B to log (A • B) (A • B 
< log(A • B) ) . 

Fig. 6D shows the synthesized Fourier image 
data after the amplitude suppression processing. In the 
5 synthesized Fourier image data that has undergone the 
amplitude suppression processing, the influence of the 
illuminance difference between the registration 
fingerprint sampling time and the collation fingerprint 
sampling time is small. More specifically, when the 

10 amplitude suppression processing is executed, the 

spectrum intensity of each pixel is suppressed. Since 
any extreme value can be eliminated, the valid 
information amount increases. In addition, when the 
amplitude suppression processing is executed, of the 

15 fingerprint information, the feature points (end points 
and branch points) or the features (vortexes and 
branches ) of ridge portions as personal information in 
the fingerprint information are emphasized. Hence, the 
flow and direction of all the ridge portions as general 

20 fingerprint information are suppressed. 

In this embodiment, log processing is executed 
as amplitude suppression processing. Alternatively, 
root processing may be executed. The present invention 
is not limited to log processing or root processing. 

25 Any other processing that can suppress the amplitude can 
be executed. When all amplitudes are suppressed to, 
e.g., 1 by amplitude suppression, i.e., only phases are 
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obtained, the calculation amount and data amount become 
smaller than in log processing or root processing. 

After the amplitude suppression processing is 
executed in step S309, the synthesized Fourier image 
5 data that has undergone the amplitude suppression 

processing is sent to the Fourier transform section 20-7 
to execute two-dimensional discrete Fourier transform 
(DFT) again (step S310). With this processing, the 
synthesized Fourier image data shown in Fig. 6D changes 

10 to synthesized image data shown in Fig. 6H. This image 
can basically be regarded as an image with convolutions 
of the collation fingerprint and registration 
fingerprint although the amplitude in the frequency 
space is suppressed. The synthesized image data 

15 represents the correlation between the two images. 

The control section 20-1 receives the 
synthesized image data obtained in step S310. The 
intensity (amplitude) of each pixel in a predetermined 
correlation component area is scanned from the 

20 synthesized image data to obtain the histogram of the 

intensities of the correlation components of the pixels 
in the collation fingerprint and registration 
fingerprint. Upper n pixels (eight pixels in this 
embodiment) which have high correlation component 

25 intensities are extracted from the histogram. The 

average of the intensities (correlation peaks) of the 
correlation components of the n extracted pixels is 
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obtained as a correlation value (score) (step S311). 
The correlation component area is defined as an area SO 
indicated by a white dot line in the synthesized Fourier 
image data shown in Fig. 6H. 
5 The control section 20-1 compares the 

correlation value obtained in step S311 with a 
predetermined threshold value (step S312). If the 
correlation value is larger than the threshold value, it 
is determined that the collation result by the amplitude 

10 suppression correlation method indicates "coincidence 

(OK)". If the correlation value is equal to or smaller 
than the threshold value, it is determined that the 
collation result by the amplitude suppression 
correlation method indicates "incoincidence (NG)" . 

15 [Feature Point Method] 

On the other hand, the control section 20-1 
binarizes the original image data of the registration 
fingerprint read out in step S302 (step S313) and 
executes thinning processing for the binarized 

20 registration fingerprint image data (step S314). 
Feature points (end points and branch points) are 
extracted from the registration fingerprint image data 
that has undergone the thinning processing, and the 
positions, directions, and types of the feature points 

25 are acquired as feature parameters (step S315). 

In addition, the control section 20-1 receives 
the collation fingerprint image data supplied from the 
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operation unit 10 through the frame memory 20-5 (step 
S316) and corrects the positional shift between the 
collation fingerprint image data and the registration 
fingerprint image data (step S317). The same 
5 binarization processing and thinning processing as in 
steps S313 and S314 are executed for the received 
collation fingerprint image data (steps S318 and S319). 
Feature points (end points and branch points) are 
extracted from the collation fingerprint image data that 

10 has undergone the binarization processing and thinning 
processing, and the positions, directions, and types of 
the feature points are acquired as feature parameters 
(step S320) . 

The control section 20-1 obtains the error 

15 values (for example, if a feature point that should be 
an end point is a branch point, the error value is 
defined as 10) of the feature point parameters such as 
the positions, directions, and types of the feature 
points of the registration fingerprint and collation 

20 fingerprint, which are extracted in steps S315 and S320. 
The error values are added to obtain a collation score 
(step S321). The resultant collation score is compared 
with a predetermined threshold value (step S322). If 
the collation score is smaller than the threshold value, 

25 it is determined that the collation result by the 

feature point method indicates "coincidence (OK)". If 
the collation score is equal to or larger than the 
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threshold value, it is determined that the collation 
result by the feature point method indicates 
" incoincidence ( NG ) " . 

[ORing Collation Result by Correlation Method (Amplitude 
5 Suppression Correlation Method) and Collation Result by 
Feature Point Method] 

The control section 20-1 executes final 
collation determination on the basis of the collation 
result obtained in step S312 by the amplitude 

10 suppression correlation method and the collation result 
obtained in step S322 by the feature point method (step 
S323). In this case, if it is determined that the 
collation result by one of the methods indicates 
"coincidence (OK)", the control section 20-1 determines 

15 that the registration fingerprint and collation 

fingerprint "coincide (match)" (step S324). To the 
contrary, if it is determined that the collation results 
by both methods indicate "incoincidence (NG)", the 
control section 20-1 determines that the registration 

20 fingerprint and collation fingerprint "do not coincide 
(mismatch)" (step S325). 

More specifically, in the collation method 
(1), when the coincidence is determined not by the 
amplitude suppression correlation method but by the 

25 feature point method, it is determined that the 

registration fingerprint and collation fingerprint 
coincide. When the coincidence is determined not by the 
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feature point method but by the amplitude suppression 
correlation method, it is determined that the 
registration fingerprint and collation fingerprint 
coincide. When the coincidence is not determined by 
5 either the amplitude suppression correlation method or 
the feature point method, it is determined that the 
registration fingerprint and collation fingerprint do 
not coincide . 

With this method, even when incoincidence is 

10 determined by the feature point method because the 

pattern is distorted due to chappy skin, coincidence is 
determined by the amplitude suppression correlation 
method. On the other hand, even when incoincidence is 
determined by the amplitude suppression correlation 

15 method because only a partial fingerprint is obtained, 
and for example, the collation fingerprint is obtained 
at only the fingertip, coincidence is determined by the 
feature point method. As described above, in the 
combined method of this embodiment, collation and 

20 determination can be done without any error for a 

fingerprint that can correctly be collated by one of the 
methods. For this reason, the collation accuracy 
greatly increases as compared to collation using a 
single method. 

25 The amplitude suppression correlation method 

may be combined with a cross correlation method (normal 
correlation which uses unprocessed amplitudes). 
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Alternatively, two collation methods of the same type 
may be combined by combining, e.g., two feature point 
methods based on different feature parameter 
definitions. In this case, however, the collation 
5 accuracy almost equals the higher one of the two 

collation accuracies . That is , the collation accuracy 
cannot increase so greatly. In the method of this 
embodiment, the correlation method and feature point 
method are combined. When it is determined that one of 

10 the collation results indicates "coincidence (OK)", the 
final collation determination result indicates 
"coincidence (matching)". Hence, the collation accuracy 
greatly increases . This large increase in collation 
accuracy can also be known from the following test 

15 result. 
[Test] 

(1) Subjects 

In this test, to obtain a clear performance 
difference for a small number of subjects, many persons 

20 who had poor fingerprint states and were hard to collate 
were intentionally collected. Twelve subjects were 
used, including eight males and four females in early 
twenties to late thirties. Seven persons had good skin 
surfaces. Three had dry skin and some difficulties in 

25 collation. Two remaining persons (one had serious 

chapping in skin and the other was suffering from atopic 
dermatitis) had difficulties in collation by the feature 
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point method. In this test, the ratio of persons who 
had difficulties in collation was 16%, which was higher 
by five times or more than in random sampling. Hence, 
it was assumed that the user recognition ratio should 
5 also decrease to 1/5 or less. 

(2) Registration 

Each person registered an image of his/her 
right index finger. 

(3) Collation 

10 As the conformation data for user recognition 

of each person, 10 images of the right index finger, 
which were obtained at different timings, were used (12 
persons X io images = a total of 120 images). 

As the conformation data for false acceptance 

15 for each person, a total of 23 fingers were used, 

including an adjacent finger, i.e., his/her right middle 
finger (one finger) and the right index fingers and 
right middle fingers of others (11 persons X 2 = 22 
fingers). Generally, another finger of the same person 

20 is more resemble than a finger of another person. When 
an adjacent finger of the same person is used, the 
deficiency in number of samples can be compensated for, 
and the reliability of false acceptance data can be 
increased. 

25 The number of times of collation was as 

follows . 

For user recognition: 12 persons X io images 
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of right index fingers of respective persons = collation 
of 120 times 

For recognition of others: 12 persons X (n 
other persons X two fingers (22 fingers) + right middle 
5 finger (one finger) of same person) = collation of 276 
times 

(4) Test Result 

The recognition performance is represented by 
two factors, i.e., FRR (False Rejection Rate) and FAR 

10 (False Acceptance Rate). The recognition performance is 
high when both the FRR and FAR are low. There is an 
expression method called an ROC (Receiver Operating 
Characteristic) curve which can represent the FRR and 
FAR simultaneously . 

15 Fig. 7 shows the ROC curves of the amplitude 

suppression correlation method (characteristic I), the 
feature point method (characteristic II), and the 
combined method of the amplitude suppression correlation 
method and feature point method (characteristic III: the 

20 method of the present invention), which are obtained by 
the above-described test result. 

In an ROC curve, a point where the FRR and FAR 
coincide is called an EER (Equal Error Rate) that is 
used as an index of recognition performance. The 

25 performance becomes high as the EER value decreases. 

Referring to Fig. 7, the EER (EER1) in an ROC curve I by 
the amplitude suppression correlation method is about 
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2.5%, the EER (EER2) in an ROC curve II by the feature 
point method is about 7%, and the EER (EER3) in an ROC 
curve III by the combined method is about 0,42%. Fig. 8 
shows the EER1 , EER2 , and EER3 as bar graphs. As can be 
5 seen from Fig. 8, when the combined method of the 

amplitude suppression correlation method and feature 
point method was used, the collation accuracy greatly 
increased. 

Fig. 9 shows functional blocks corresponding 

10 to the collation processing (collation method (1)) 
executed in accordance with the flow chart shown in 
Fig. 5. The control unit 20 has, as functional blocks, 
a first collation section 20A which executes collation 
by the amplitude suppression correlation method, a 

15 second collation section 20B which executes collation by 
the feature point method, a registration fingerprint 
storage section 20C, and a collation determination 
section 20D. 

A registration fingerprint input from an 

20 operation unit 10A is stored in the registration 

fingerprint storage section 20C. When a collation 
fingerprint is input from the operation unit 10A, the 
collation fingerprint is supplied to the first collation 
section 20A and second collation section 20B. The first 

25 collation section 20A reads out the registration 

fingerprint from the registration fingerprint storage 
section 20C and collates the registration fingerprint 



- 26 - 



with the collation fingerprint from the operation unit 
10A by the amplitude suppression correlation method. 
The second collation section 20B reads out the same 
registration fingerprint from the registration 
5 fingerprint storage section 20C and collates the 

registration fingerprint with the collation fingerprint 
from the operation unit 10A by the feature point method. 
The collation result from the first collation section 
20A and the collation result from the second collation 

10 section 20B are supplied to the collation determination 
section 20D. If the collation result by one of the 
methods indicates "coincidence (OK)" , the collation 
determination section 20D determines that the 
registration fingerprint and collation fingerprint 

15 "coincide (match) " . 

[Fingerprint Collation: Collation Method (2) 
(Preferential Execution of Correlation Method)] 

In the collation method ( 1 ) according to the 
flow chart shown in Fig. 5, collation by the amplitude 

20 suppression correlation method and collation by the 
feature point method are executed. If the collation 
result by one of the methods indicates "coincidence 
(OK)", it is determined that the registration 
fingerprint and collation fingerprint "coincide 

25 (match)". In the collation method (2), collation by the 
amplitude suppression correlation method is executed 
first. If the collation result by the amplitude 
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suppression correlation method indicates "coincidence 
(OK)", it is determined that the registration 
fingerprint and collation fingerprint "coincide (match)" 
without executing collation by the feature point method. 
5 As is apparent from the above -described test 

result (Figs. 7 and 8), the collation accuracy is 
generally higher in the amplitude suppression 
correlation method than in the feature point method. If 
the registration fingerprint and collation fingerprint 

10 are identical, collation can be finished in one cycle at 
a high probability by using the amplitude suppression 
correlation method rather than the feature point method. 
The total collation time required in the collation 
method (1) is the sum of the processing time necessary 

15 for collation by the amplitude suppression correlation 
method and the processing time necessary for collation 
by the feature point method. (The flow chart shown in 
Fig. 5 and the functional block diagram shown in Fig. 9 
illustrate collation by the amplitude suppression 

20 correlation method and collation by the feature point 
method as if they were executed in parallel. However, 
since one CPU actually executes the processing 
operations, the total time is the sum of times of the 
two processing operations). In the collation method 

25 (2), when the collation result by the amplitude 

suppression correlation method indicates coincidence, 
collation by the feature point method is not executed. 
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Hence, the collation determination result can quickly be 
obtained (this applies to most cases because the 
collation accuracy is higher in the amplitude 
suppression correlation method than in the feature point 
5 method) . Even when the fingerprint cannot be correctly 
collated by the amplitude suppression correlation 
method, it can correctly be collated by the feature 
point method. Hence, the collation accuracy increases. 
Fig. 10 shows collation by the collation 

10 method (2). As shown in this flow chart, in the 
collation method (2), collation by the amplitude 
suppression correlation method is executed in steps S401 
to S412 corresponding to steps S301 to S312 in Fig. 5. 
When it is confirmed that the collation result by the 

15 amplitude suppression correlation method is "coincidence 
(OK)" (YES in step S413), it is immediately determined 
that the registration fingerprint and collation 
fingerprint "coincide (match)" (step S414). 

To the contrary, when it is confirmed that the 

20 collation result by the amplitude suppression 

correlation method is "incoincidence (NG)" (NO in step 
S413), collation by the feature point method is executed 
in steps S415 to S424 corresponding to steps S313 to 
S322 in Fig. 5. When it is confirmed that the collation 

25 result by the feature point method is "coincidence (OK)" 
(YES in step S425), it is determined that the 
registration fingerprint and collation fingerprint 
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"coincide (match)" (step S414). If the collation result 
by the feature point method also indicates 
"incoincidence (NG)" (NO in step S425), it is determined 
that the registration fingerprint and collation 
5 fingerprint "do not coincide (mismatch)" (step S426). 

Fig. 11 shows functional blocks corresponding 
to the collation processing (collation method (2)) 
executed in accordance with the flow chart shown in 
Fig. 10. The control unit 20 has, as functional blocks, 

10 the first collation section 20A which executes collation 
by the amplitude suppression correlation method, the 
second collation section 20B which executes collation by 
the feature point method, the registration fingerprint 
storage section 20C, and a collation determination 

15 section 20D' . 

The collation fingerprint input line to the 
first collation section 20A and second collation section 
20B has a changeover switch SW1. The registration 
fingerprint input line to the first collation section 

20 20A and second collation section 20B has a changeover 
switch SW2 . In the changeover switch SW1 , the 
conduction path between terminals cl and al is normally 
ON. In the changeover switch SW2, the conduction path 
between terminals c2 and a2 is normally ON. The 

25 conduction paths are switched to bl and b2 sides, 

respectively, in accordance with a command from the 
collation determination section 20D* . 
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A registration fingerprint from the operation 
unit 10A is stored in the registration fingerprint 
storage section 20C. When a collation fingerprint is 
input from the operation unit 10A, the collation 
5 fingerprint is supplied to the first collation section 
20A through the changeover switch SW1 . The first 
collation section 20A reads out the registration 
fingerprint from the registration fingerprint storage 
section 20C through the changeover switch SW2, collates 

10 the readout registration fingerprint with the collation 
fingerprint from the operation unit 10A by the amplitude 
suppression correlation method, and sends the collation 
result to the collation determination section 20D' . If 
the collation result from the first collation section 

15 20A is "coincidence (OK)" , the collation determination 
section 20D' determines that the registration 
fingerprint and collation fingerprint "coincide 
(match) " . 

If the collation result from the first 
20 collation section 20A is "incoincidence (NG)" , the 

collation determination section 20D' sends a switching 
command to the changeover switches SW1 and SW2 to turn 
on the conduction path between the terminals cl and bl 
of the changeover switch SW1 and the conduction path 
25 between the terminals c2 and b2 of the changeover switch 
SW2 . Accordingly, the collation fingerprint from the 
operation unit 10A is supplied to the second collation 
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section 20B through the changeover switch SW1. The 
second collation section 20B reads out the registration 
fingerprint from the registration fingerprint storage 
section 20C through the changeover switch SW2 , collates 
5 the readout registration fingerprint with the collation 
fingerprint from the operation unit 10A by the feature 
point method, and sends the collation result to the 
collation determination section 20D 1 . If the collation 
result from the second collation section 20B is 

10 "coincidence (OK)", the collation determination section 
20D' determines that the registration fingerprint and 
collation fingerprint "coincide (match)". 
[Fingerprint Collation: Collation Method (3) 
(Preferential Execution of Feature Point Method)] 

15 In the collation method (2), collation by the 

amplitude suppression correlation method is executed 
first. If the collation result by the amplitude 
suppression correlation method indicates "coincidence 
(OK)", it is determined that the registration 

20 fingerprint and collation fingerprint "coincide (match)" 
without executing collation by the feature point method. 
In the collation method (3), collation by the feature 
point method is executed first. If the collation result 
by the feature point method indicates "coincidence 

25 (OK)", it is determined that the registration 

fingerprint and collation fingerprint "coincide (match)" 
without executing collation by the amplitude suppression 
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correlation method. 

According to the collation method (3), when 
the attribute of a pattern to be collated is suitable 
for the feature point method (for example, when the 
5 feature points are clear, the pattern is resistant to 
disturbance, or the pattern does not deform), or 1-to-N 
collation (a method of collating one collation pattern 
with N registration patterns) should be executed, the 
arithmetic amount for collation can be small. For this 

10 reason, the collation accuracy increases, and the 

collation result can be obtained in a short time. More 
specifically, in the amplitude suppression correlation 
method, arithmetic processing is executed to obtain 
correlation values by using all pixel data in a 

15 collation pattern. Hence, a long time is taken to 

obtain a collation result. On the other hand, in the 
feature point method, arithmetic processing is executed 
using only the pixel data of feature points in 
registration and collation patterns. Hence, the amount 

20 of data to be processed is small, and a collation result 
can be obtained in a short time. Especially, the time 
difference between 1-to-N collation and 1-to-l collation 
acceleratively increase. 

Fig. 12 shows collation by the collation 

25 method (3). As shown in this flow chart, in the 

collation method (3), collation by the feature point 
method is executed in steps S801 to S813 corresponding 
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to steps S301, S302 and S313 to S322 in Fig. 5. When it 
is confirmed that the collation result by the feature 
point method is "coincidence (OK)" (YES in step S814), 
it is immediately determined that the registration 
5 fingerprint and collation fingerprint "coincide (match)" 
(step S815) . 

To the contrary, when it is confirmed that the 
collation result by the feature point method is 
"incoincidence (NG)" (NO in step S814), collation by the 

10 amplitude suppression collation method is executed in 
steps S816 to S824 corresponding to steps S303 to S312 
in Fig. 5. When it is confirmed that the collation 
result by the amplitude suppression collation method is 
"coincidence (OK)" (YES in step S825), it is determined 

15 that the registration fingerprint and collation 

fingerprint "coincide (match)" (step S815). If the 
collation result by the amplitude suppression collation 
method also indicates "incoincidence (NG)" (NO in step 
S825), it is determined that the registration 

20 fingerprint and collation fingerprint "do not coincide 
(mismatch)" (step S826). 

Fig. 13 shows functional blocks corresponding 
to the collation processing (collation method (3)) 
executed in accordance with the flow chart shown in 

25 Fig. 12. Referring to this functional block diagram, in 
the changeover switch SW1, the conduction path between 
the terminal cl and a terminal bl is normally ON. In 
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the changeover switch SW2 , the conduction path between 
the terminal c2 and a terminal b2 is normally ON. The 
conduction paths are switched to the al and a2 sides, 
respectively, in accordance with a command from the 
5 collation determination section 20D' . 

A registration fingerprint from the operation 
unit 10A is stored in the registration fingerprint 
storage section 20C. When a collation fingerprint is 
input from the operation unit 10A, the collation 

10 fingerprint is supplied to the second collation section 
20B through the changeover switch SW1 . The second 
collation section 20B reads out the registration 
fingerprint from the registration fingerprint storage 
section 20C through the changeover switch SW2 , collates 

15 the readout registration fingerprint with the collation 
fingerprint from the operation unit 10A by the feature 
point method, and sends the collation result to the 
collation determination section 20D' . If the collation 
result from the second collation section 20B is 

20 "coincidence (OK) M , the collation determination section 
20D* determines that the registration fingerprint and 
collation fingerprint "coincide (match)". 

If the collation result from the second 
collation section 20B is "incoincidence (NG)", the 

25 collation determination section 20D' sends a switching 
command to the changeover switches SW1 and SW2 to turn 
on the conduction path between the terminals cl and al 
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of the changeover switch SW1 and the conduction path 
between the terminals c2 and a2 of the changeover switch 
SW2. Accordingly, the collation fingerprint from the 
operation unit 10A is supplied to the first collation 
5 section 20A through the changeover switch SW1 . The 

first collation section 20A reads out the registration 
fingerprint from the registration fingerprint storage 
section 20C through the changeover switch SW2, collates 
the readout registration fingerprint with the collation 

10 fingerprint from the operation unit 10A by the amplitude 
suppression collation method, and sends the collation 
result to the collation determination section 20D' . If 
the collation result from the first collation section 
20A is "coincidence (OK)", the collation determination 

15 section 20D' determines that the registration 

fingerprint and collation fingerprint "coincide 
(match) " . 

[Collation Method (4) (Collation Execution Order 
Designation) ] 

20 In the collation method (2) shown in Fig. 11 

as a functional block diagram, collation by the 
amplitude suppression correlation method is always 
executed first. This processing assumes fingerprint 
collation. If handwritten characters should be 

25 collated, the collation accuracy is higher in collation 
by the feature point method than in collation by the 
amplitude suppression correlation method. In this case. 
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collation by the feature point method is preferably 
executed first so that a determination result can 
quickly be obtained. 

More specifically, when the compatibility 
5 (which collation method has a higher collation accuracy 
when collation is executed by using only one of the 
correlation method and the feature point method) between 
the two collation methods and the pattern to be collated 
is known in advance, the method to be used first for 

10 collation is designated. If the registration pattern 
and collation pattern are identical, collation can be 
finished in one cycle at a high probability, and the 
collation determination result can quickly be obtained. 
In the collation method (4), when patterns of a 

15 plurality of types with different pattern attributes are 
to be collated by using a single pattern collation 
apparatus, the optimum execution order can be designated 
at an appropriate time. 

Fig. 14 shows functional blocks when the 

20 collation method (4) is employed. A pattern 

determination section 40 has, as functional blocks, a 
first collation section 40A which executes collation by 
the amplitude suppression correlation method, a second 
collation section 40B which executes collation by the 

25 feature point method, a registration pattern storage 

section 40C, and a collation determination section 40D. 

The collation pattern input line to the first 
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collation section 40A and second collation section 40B 
has the changeover switch SW1 . The registration pattern 
input line to the first collation section 40A and second 
collation section 40B has the changeover switch SW2 . 
5 For the changeover switch SW1 , the collation 

determination section 40D sends an instruction so that 
the common terminal cl is connected to the terminal al 
(mode A) or terminal bl (mode B) . Similarly, for the 
changeover switch SW2 , the collation determination 
10 section 40D sends an instruction so that the common 

terminal c2 is connected to the terminal a2 (mode A) or 
terminal b2 (mode B) . 

[When Collation by Correlation Method (Amplitude 
Suppression Correlation Method) Should Be Executed 
15 First] 

When designation (initial setting) is done by 
an execution order designation section 50 to execute 
collation by the amplitude suppression correlation 
method first, the collation determination section 40D 

20 sends a command to the changeover switches SW1 and SW2 . 
Both the changeover switches SW1 and SW2 are set in the 
mode A in the initial state. More specifically, the 
conduction path between the common terminal cl and the 
terminal al of the switch SW1 is set on, and the 

25 conduction path between the common terminal c2 and the 
terminal a2 of the switch SW2 is set on. 

When a collation pattern is input from a 
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pattern input section 30 , the collation pattern is 
supplied to the first collation section 40A through the 
changeover switch SW1 . The first collation section 40A 
reads out the registration pattern from the registration 
5 pattern storage section 40C through the changeover 

switch SW2 , collates the readout registration pattern 
with the collation pattern from the pattern input 
section 30 by the amplitude suppression correlation 
method, and sends the collation result to the collation 
10 determination section 40D. If the collation result from 
the first collation section 40A is "coincidence (OK)", 
the collation determination section 40D determines that 
the registration pattern and collation pattern "coincide 
(match) " . 

15 If the collation result from the first 

collation section 40A is "incoincidence (NG)", the 
collation determination section 40D sends a command to 
the changeover switches SW1 and SW2 to set both the 
changeover switches SW1 and SW2 in the mode B. More 

20 specifically, the conduction path between the terminals 
cl and bl of the changeover switch SW1 is set on, and 
the conduction path between the terminals c2 and b2 of 
the changeover switch SW2 is set on. 

Accordingly, the collation pattern from the 

25 pattern input section 30 is supplied to the second 

collation section 40B through the changeover switch SW1 . 
The second collation section 40B reads out the same 
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registration pattern from the registration pattern 
storage section 40C through the changeover switch SW2 , 
collates the readout registration pattern with the 
collation pattern from the pattern input section 30 by 
5 the feature point method, and sends the collation result 
to the collation determination section 40D. If the 
collation result from the second collation section 40B 
is "coincidence (OK)", the collation determination 
section 40D determines that the registration pattern and 

10 collation pattern "coincide (match)". 

[When Collation by Feature Point Method Should Be 
Executed First] 

When designation (initial setting) is done by 
the execution order designation section 50 to execute 

15 collation by the feature point method first, the 

collation determination section 40D sends a command to 
the changeover switches SW1 and SW2 . Both the 
changeover switches SW1 and SW2 are set in the mode B in 
the initial state. More specifically, the conduction 

20 path between the common terminal cl and the terminal bl 
of the switch SW1 is set on, and the conduction path 
between the common terminal c2 and the terminal b2 of 
the switch SW2 is set on. 

When a collation pattern is input from the 

25 pattern input section 30, the collation pattern is 

supplied to the second collation section 40B through the 
changeover switch SW1. The second collation section 40B 



- 40 - 



reads out the registration pattern from the registration 
pattern storage section 40C through the changeover 
switch SW2 , collates the readout registration pattern 
with the collation pattern from the pattern input 
5 section 30 by the feature point method, and sends the 
collation result to the collation determination section 
40D. If the collation result from the second collation 
section 40B is "coincidence (OK)", the collation 
determination section 40D determines that the 
10 registration pattern and collation pattern "coincide 
(match) " . 

If the collation result from the second 
collation section 40B is "incoincidence (NG)", the 
collation determination section 40D sends a command to 

15 the changeover switches SW1 and SW2 to set both the 
changeover switches SW1 and SW2 in the mode A, More 
specifically, the conduction path between the terminals 
cl and al of the changeover switch SW1 is set on, and 
the conduction path between the terminals c2 and a2 of 

20 the changeover switch SW2 is set on. 

Accordingly, the collation pattern from the 
pattern input section 30 is supplied to the first 
collation section 40A through the changeover switch SW1 . 
The first collation section 40A reads out the same 

25 registration pattern from the registration pattern 

storage section 40C through the changeover switch SW2 , 
collates the readout registration pattern with the 
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collation pattern from the pattern input section 30 by 
the amplitude suppression correlation method, and sends 
the collation result to the collation determination 
section 40D. If the collation result from the first 
5 collation section 40A is "coincidence (OK)", the 

collation determination section 40D determines that the 
registration pattern and collation pattern "coincide 
(match)". 

[Collation Method (5) (Automatic Collation Execution 

10 Order Designation)] 

In the collation method (5), when patterns of 
a plurality of types with different pattern attributes 
are to be collated by using a single pattern collation 
apparatus, the optimum execution order is automatically 

15 be designated at an appropriate time. In this automatic 
execution order designation, collation by a collation 
method suitable for each collation pattern is 
preferentially executed. For example, when the area of 
the collation pattern is small, or the collation pattern 

20 has a high image quality, collation by the feature point 
method is executed first. Hence, both the collation 
accuracy and the collation speed can be increased. 

Fig. 15 shows collation by the collection 
method (5). As shown in this flow chart, in the 

25 collation method (5), the area S of the collation 

fingerprint is calculated (step S901). The calculated 
collation area S is compared with the predetermined 
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threshold value Sth. When S ^ Sth (NO in step S902: 
small area), the flow advances to step S802 in Fig. 12 
to execute fingerprint collation by the collation method 
(3) (preferential execution of feature point method). 
5 When S > Sth (YES in step S902: large area), 

the image quality value Q of the collation fingerprint 
is calculated (step S903). The calculated image quality 
value Q is compared with a predetermined threshold value 
Qth. When Q ^ Qth (NO in step S904: high image 

10 quality), the flow advances to step S802 in Fig. 12 to 
execute fingerprint collation by the collation method 
(3) (preferential execution of feature point method). 
When Q > Qth (YES in step S904: poor image quality), the 
flow advances to step S402 in Fig. 10 to execute 

15 fingerprint collation by the collation method (2) 
(preferential execution of correlation method). 
Calculation of the collation area S in step S901 and 
calculation of the image quality value Q in step S903 
are executed in accordance with the same procedures as 

20 those described with reference to the flow chart in 

Fig. 3, and a description thereof will be omitted here. 

In the collation method (5), the image of the 
collation fingerprint is inspected first to confirm 
whether the collation fingerprint has a sufficient area 

25 and high image quality. When the amplitude suppression 
correlation method is used for a collation fingerprint 
having a small area, it is erroneously recognized as 
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"incoincidence" at a high probability because collation 
is done on the basis of the similarity of the entire 
image. In such a case, the feature point method is more 
appropriate, and collation by the feature point method 
5 is executed first. When the image has a high quality 
and clear feature points but also contains a large 
distortion, the fingerprint is still erroneously 
recognized as "incoincidence" at a high probability by 
the amplitude suppression correlation method. In this 

10 case, not collation by the amplitude suppression 

correlation method but collation by the feature point 
method is executed first. 

Fig. 16 shows functional blocks when the 
collation method (5) is employed. Referring to the 

15 functional block diagram, the collation determination 
section 40D has an image inspection means 40D1, 
execution order designation means 40D2, and collation 
determination means 40D3. The image inspection means 
40D1 that forms part of the collation determination 

20 section 40D inspects the area and image quality of a 

collation pattern and sends the inspection result to the 
execution order designation means 40D2. When the 
collation pattern has a small area or a high image 
quality, the execution order designation means 40D2 

25 sends a command to the changeover switches SW1 and SW2 
to set both of them in the mode B on the basis of the 
inspection result from the image inspection means 40D1. 
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More specifically, the conduction path between the 
terminals cl and bl of the changeover switch SW1 is set 
on, and the conduction path between the terminals c2 and 
b2 of the changeover switch SW2 is set on. When the 
5 collation pattern has a large area or a poor image 

quality, a command is sent to the changeover switches 
SW1 and SW2 to set both of them in the mode A. More 
specifically, the conduction path between the terminals 
cl and al of the changeover switch SW1 is set on, and 

10 the conduction path between the terminals c2 and a2 of 
the changeover switch SW2 is set on. 

In the flow chart shown in Fig. 5, the 
original image data of the registration fingerprint is 
read out (step S302), and reduction processing and 

15 two-dimensional discrete Fourier transform are executed 
for the readout original image data of the registration 
fingerprint (steps S303 and S304) at the time of 
collation. However, these processing operations may be 
executed for the original image data of the registration 

20 fingerprint at the time of registration, and a file of 
the processed data may be created as registration data. 
In this case, the collation time can be shortened. This 
also applies to the flow charts shown in Figs. 10 and 
12. 

25 Fig. 17 shows processing in which the 

reduction processing and two-dimensional discrete 
Fourier transform, which are necessary for collation by 
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the correlation method and the binarization processing, 
thinning processing, and feature point extraction, which 
are necessary for collation by the feature point method, 
are executed for the original image data of a 
5 registration fingerprint in advance to prepare and 

register registration data for the correlation method 
and registration data for the feature point method to 
shorten the collation time. After processing in steps 
S501 to S506 corresponding to steps S101 to S106 in the 

10 flow chart of Fig. 2 is executed, reduction processing 
and two-dimensional discrete Fourier transform are 
executed for registration fingerprint image data 
selected in step S506 (steps S507 and S508). A file of 
the image data is created as registration data for the 

15 amplitude suppression correlation method (step S509). 
In addition, binarization processing, thinning 
processing, and feature point extraction are also 
executed for the registration fingerprint image data 
selected in step S506 (steps S510, S511, and S512). A 

20 file is created as registration data for the feature 
point method (step S513). 

In the flow chart shown in Fig. 5 (Fig. 10 or 
12), two-dimensional discrete Fourier transform is 
executed in step S310 (S410 or S819). Instead of 

25 two-dimensional discrete Fourier transform, 

two-dimensional discrete inverse Fourier transform may 
be executed. More specifically, not two-dimensional 
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discrete Fourier transform but two-dimensional discrete 
inverse Fourier transform may be executed for 
synthesized Fourier image data that has undergone 
amplitude suppression processing. Two-dimensional 
5 discrete Fourier transform and two-dimensional discrete 
inverse Fourier transform quantitatively have the same 
collation accuracy. The two-dimensional discrete 
inverse Fourier transform is described in reference 1 . 

In the flow chart shown in Fig. 5 (Fig. 10 or 

10 12), amplitude suppression processing is executed for 

synthesized Fourier image data, and then two-dimensional 
discrete Fourier transform is executed (steps S309 and 
S310 (S409 and S410 or S821 and S822)). Instead, 
amplitude suppression processing may be executed for 

15 each of the Fourier image data of the registration 

fingerprint and that of the collation fingerprint before 
synthesis, and then the two Fourier image data may be 
synthesized. 

The amplitude suppression ratio of the 

20 synthesized Fourier image data at this time is lower 
than that when synthesized Fourier image data is 
subjected to amplitude suppression processing. Hence, 
the collation accuracy is higher when amplitude 
suppression processing is executed for synthesized 

25 Fourier image data than when synthesized Fourier image 
data is generated after amplitude suppression 
processing. Even when the synthesized Fourier image 
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data is generated after amplitude suppression 
processing, not two-dimensional discrete Fourier 
transform but two-dimensional discrete inverse Fourier 
transform may be executed for the synthesized Fourier 
5 image data. 

In the flow chart shown in Fig. 10, the 
correlation value obtained in step S411 is compared with 
only one predetermined threshold value (step S412). 
When the correlation value is equal to or smaller than 

10 the only threshold value, it is determined that the 
collation result by the amplitude suppression 
correlation method indicates "incoincidence (NG)" , and 
collation by the feature point method is executed. 
However, a first threshold value and second threshold 

15 value may be defined (first threshold value > second 

threshold value). Only when the correlation value falls 
between the first threshold value and the second 
threshold value, collation by the feature point method 
may be executed. In this case, when the correlation 

20 value is equal to or less than the second threshold 
value, it is determined that coincidence is unlikely 
obtained even by the feature point method and that the 
registration fingerprint and collation fingerprint "do 
not coincide (mismatch)". 

25 In the above -described embodiment, amplitude 

suppression correlation is used as an example of the 
correlation method. However, a cross correlation method 
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(a normal correlation method which uses unprocessed 
amplitudes) or a correlation method based on an 
Euclidean distance (a correlation method which uses a 
distance for an amplitude after Fourier transform or 
5 "rotation-invariant amplitude suppression correlation 
method" (an amplitude suppression correlation method 
which corrects the rotational shift between a 
registration pattern and a collation pattern) disclosed 
in Japanese Patent Laid-Open No. 10-124667) may be used. 
10 [Second Embodiment (Seventh and Eighth Inventions): 
Rotation- Invariant Amplitude Suppression Correlation 
Method (Amplitude Suppression + Presence of Phase) + 
Amplitude Suppression Correlation Method + Feature Point 
Method] 

15 In the second embodiment, two-dimensional 

discrete Fourier transform is executed for registration 
fingerprint image data R to generate registration 
Fourier image data R p . Two-dimensional discrete Fourier 
transform is executed for collation fingerprint image 

20 data I to generate collation Fourier image data I p . The 
coordinate system of the registration Fourier image data 
R p and collation Fourier image data I p is transformed 
into a polar coordinate system. Registration Fourier 
image data R p and collation Fourier image data I p 

25 transformed into the polar coordinate system are 

collated by using the amplitude suppression correlation 
method (coarse collation: first collation). 
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When no collation result indicating 
coincidence is obtained by the first collation, a 
rotational shift amount A 6 between the two image data 
is obtained from the position of the correlation peak 
5 obtained in the collation process of the first 

collation. On the basis of the obtained rotational 
shift amount A 6 , rotation shift correction is 
performed for one of the registration fingerprint and 
collation fingerprint. Then, the registration 

10 fingerprint and collation fingerprint are collated again 
by the amplitude suppression correlation method (fine 
collation: second collation). 

When no collation result indicating 
coincidence is obtained by the second collation, 

15 vertical and horizontal shift amounts Ax and Ay 
between the two image data are obtained from the 
position of the correlation peak obtained in the 
collation process of the second collation. On the basis 
of the obtained vertical and horizontal shift amounts A 

20 X and Ay and the rotational shift amount A 0 obtained 
from the position of the correlation peak obtained in 
the collation process of the first collation, rotation 
shift correction and vertical/horizontal shift 
correction are performed for one of the registration 

25 pattern and collation pattern. Then, the registration 
pattern and collation pattern are collated by the 
feature point method (third collation). 
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The fingerprint collation operation according 
to the second embodiment will be described below in 
detail with reference to flow charts. 
[Fingerprint Registration] 
5 In the second embodiment, as shown in the flow 

chart of Fig. 18, processing in steps S601 and S602 is 
executed in correspondence with steps S101 and S102 in 
Fig. 2. A file of the registration fingerprint image 
data R that is reduced in step S603 is created as the 

10 original image data of the registration fingerprint in 
correspondence with an ID number (step S604). 
Two-dimensional discrete Fourier transform may be 
executed for the registration fingerprint image data R 
to generate the registration Fourier image data R p , and 

15 a file of the registration Fourier image data R p may be 
created as the original image data of the registration 
fingerprint in correspondence with the ID number. 
[ Fingerprint Collation ] 

Fingerprint collation is executed in the 

20 following way. When an ID number is input (step S701 in 
Fig. 20), a file of the registration fingerprint image 
data R corresponding to the ID number is read out (step 
S702: Fig. 21A) . A collation fingerprint is input (step 
S703). Reduction processing is executed for the 

25 collation fingerprint (step S704) to obtain the 
collation fingerprint image data I (Fig. 21B) . 
Two-dimensional discrete Fourier transform is executed 
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for the registration fingerprint image data R read out 
in step S702 to generate the registration Fourier image 
data R p (step S705: Fig. 21C) . Two-dimensional discrete 
Fourier transform is executed for the collation 
5 fingerprint image data I obtained in step S704 to 

generate the collation Fourier image data I p (step S706: 
Fig. 21D). 

The registration Fourier image data R p and 
collation Fourier image data I p contain amplitude 

10 components and phase components. The registration 

Fourier image data R p and collation Fourier image data I p 
have a Cartesian coordinate system, i.e., an (x,y) 
coordinate system. Amplitude suppression processing is 
executed for the registration Fourier image data R p and 

15 collation Fourier image data I p (steps S707 and S708). 

The coordinate system of registration Fourier image data 
R m and collation Fourier image data I__ obtained by 
amplitude suppression processing is transformed into a 
polar coordinate system (step S709 and S710), thereby 

20 obtaining registration Fourier image data R pL and 

collation Fourier image data I nT transformed into the 

PL 

polar coordinate system (Figs. 21E and 21F). 

Polar coordinate transformation means 
processing for transforming a Cartesian coordinate 
2 5 system (x,y) into a polar coordinate system (r, 6 ) . 

More specifically, a Cartesian coordinate system (x=rcos 
0,y=rsin0) shown in Fig. 19A is transformed into a 
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polar coordinate system (r=(x 2 +y 2 ) 1/2 , 6 =tan *(y/x) ) shown 
in Fig- 19B. 

[Coarse Collation (First Collation)] 

The registration Fourier image data R pL 
5 transformed into the polar coordinate system in step 

5709 is collated by the amplitude suppression 
correlation method with the collation Fourier image data 
I pL transformed into the polar coordinate system in step 

5710 (step S711). Fig. 22 shows the collation process. 
10 In this case, two-dimensional discrete Fourier 

transform is executed for the registration Fourier image 
data R DT (Fig. 24A) and collation Fourier image data I m 

PL PL 

(Fig. 24B) transformed into the polar coordinate system 
(steps S711-1 and S711-2) to obtain registration Fourier 

15 image data R pLp (Fig. 24C) and collation Fourier image 
data I pLp (Fig. 24E) . 

The registration Fourier image data R and 
collation Fourier image data I orp are synthesized (step 
S711-3) to obtain synthesized Fourier image data. 

20 Amplitude suppression processing is executed for the 

synthesized Fourier image data (step S711-4: Fig. 24G) . 
Two-dimensional discrete Fourier transform is executed 
for the synthesized Fourier image data that has 
undergone the amplitude suppression processing (step 

25 S711-5: Figs. 24H and 21G, Fig. 24H = Fig. 21G) . 

In this example, amplitude suppression 
processing is executed for the synthesized Fourier image 
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data of R_. _ and I or _. However, the amplitude suppression 

Pur YhY 

processing may be executed for R pLp and I pLp to obtain 
registration Fourier image data R pLp f and collation 
Fourier image data I pLp ' (Figs. 24D and 24F), and R pLp ' and 
5 I 1 may be synthesized. Referring to Figs. 24D, 24F, 

and 24G # all amplitudes are suppressed to 1 by amplitude 
suppression. That is, only phases are obtained. 

The intensity (amplitude) of the correlation 
component of each pixel in a predetermined correlation 

10 component area is scanned from the synthesized Fourier 
image data that has undergone the two-dimensional 
discrete Fourier transform to obtain the histogram of 
the intensities of the correlation components of the 
pixels . Upper n pixels which have high correlation 

15 component intensities are extracted from the histogram. 
The average of the intensities of the correlation 
components of the n extracted pixels is obtained as a 
correlation value (score) (step S711-6). If the 
resultant correlation value is larger than a 

20 predetermined threshold value (YES in step S711-7), it 
is roughly determined that the registration fingerprint 
and collation fingerprint indicate "coincidence (OK)". 
If the resultant correlation value is equal to or 
smaller than the predetermined threshold value (NO in 

25 step S711-7), it is determined that the registration 
fingerprint and collation fingerprint indicate 
" incoincidence ( NG ) " . 
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When it is determined by the first collation 
that the registration fingerprint and collation 
fingerprint indicate "incoincidence ( NG ) " , a pixel 
having the highest correlation component intensity is 
5 obtained, as a correlation peak, from the synthesized 
Fourier image data that has undergone the 
two-dimensional discrete Fourier transform in step 
S711-5. The rotational shift amount A 9 between the 
registration fingerprint and the collation fingerprint, 

10 i.e., the rotational shift amount A 0 between the 

registration fingerprint image data R and the collation 
fingerprint image data I is obtained from the position 
of the correlation peak (step S711-8). 

Referring to Fig. 21G, a correlation peak PI 

15 appears. The rotational shift amount A 9 is obtained 

from the positional relationship between the correlation 
peak PI and the center of the correlation area. More 
specifically, the rotational shift amount A 9 is 
obtained from the vertical position of the correlation 

20 peak PI in the area shown in Fig. 21G. In this case, 
the upper limit position in the vertical direction in 
the area is A 9 = +180°, and the lower limit position is 
A 9 = -180°. 

[Fine Collation (Second Collation)] 
25 When "incoincidence (NG)" is determined by the 

first collation, and the rotational shift amount A 9 
between the registration fingerprint image data R and 
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the collation fingerprint image data I is obtained, the 
rotational shift of the collation fingerprint image data 
I is corrected on the basis of the obtained rotational 
shift amount A 0 . Then, the registration fingerprint 
5 and collation fingerprint are collated again by the 
amplitude suppression correlation method (step S712). 
Fig. 23 shows the collation process. 

In this case, the rotational shift amount A 6 
of the collation fingerprint image data I is corrected 

10 (step S712-1) to obtain image data I N whose rotation 
angle coincides with that of the registration 
fingerprint image data R (Figs. 25A and 25B) . 
Two-dimensional discrete Fourier transform is executed 
for the collation fingerprint image data I N (step 

15 S712-2) to obtain collation Fourier image data 1^ 
(Fig. 25E). 

The collation Fourier image data 1^ and the 
registration Fourier image data R p (Fig. 25C) obtained 
in step S705 are synthesized (step S712-3) to obtain 

20 synthesized Fourier image data. Amplitude suppression 

processing is executed for the synthesized Fourier image 
data (step S712-4). Two-dimensional discrete Fourier 
transform is executed for the synthesized Fourier image 
data (Fig. 25G) that has undergone the amplitude 

25 suppression processing (step S712-5). 

The intensity (amplitude) of the correlation 
component of each pixel in a predetermined correlation 
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component area is scanned from the synthesized Fourier 
image data (Fig. 25H) that has undergone the 
two-dimensional discrete Fourier transform to obtain the 
histogram of the intensities of the correlation 
5 components of the pixels. Upper n pixels which have 
high correlation component intensities are extracted 
from the histogram. The average of the intensities of 
the correlation components of the n extracted pixels is 
obtained as a correlation value (score) (step S712-6). 

10 The correlation value obtained in step S712-6 

is compared with a predetermined threshold value. If 
the correlation value is larger than the threshold value 
(YES in step S712-7), it is determined that the 
registration fingerprint and collation fingerprint 

15 indicate "coincidence (OK)". If the correlation value 
is equal to or smaller than the threshold value (NO in 
step S712-7), it is determined that the registration 
fingerprint and collation fingerprint indicate 
" incoincidence ( NG ) " . 

20 When it is determined by the second collation 

that the registration fingerprint and collation 
fingerprint indicate "incoincidence (NG)", a pixel 
having the highest correlation component intensity is 
obtained, as a correlation peak, from the synthesized 

25 Fourier image data that has undergone the 

two-dimensional discrete Fourier transform in step 
S712-5. The vertical and horizontal shift amounts Ax 
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and Ay between the registration fingerprint and the 
collation fingerprint, i.e., the vertical and horizontal 
shift amounts Ax and Ay between the registration 
fingerprint image data R and the collation fingerprint 
5 image data I is obtained from the position of the 
correlation peak (step S712-8). 

In this example, amplitude suppression 
processing is executed for the synthesized Fourier image 
data of R p and 1^. However, the amplitude suppression 
10 processing may be executed for R p and 1^ to obtain 
registration Fourier image data R p " and collation 
Fourier image data 1^' (Figs. 25D and 25F), and R p ' and 
may be synthesized. Referring to Figs. 25D, 25F, 

nr 

and 25G, all amplitudes are suppressed to 1 by amplitude 
15 suppression. That is, only phases are obtained. 

Referring to Fig. 23, the rotational shift of 
the collation fingerprint image data I is corrected, and 
the registration fingerprint and collation fingerprint 
are collated again. However, the rotational shift 
20 amount of the registration fingerprint image data R may 
be corrected, and the registration fingerprint and 
collation fingerprint may be collated again. 
[Collation by Feature Point Method (Third Collation)] 

When "incoincidence (NG)" is determined by the 
2 5 second collation, and the vertical and horizontal shift 
amounts Ax and Ay between the registration fingerprint 
image data R and the collation fingerprint image data I 
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are obtained, the rotational shift and vertical and 
horizontal shifts of the collation fingerprint image 
data I are corrected on the basis of the vertical and 
horizontal shift amounts Ax and Ay and the rotational 
5 shift amount A 6 obtained in the first collation. 
Then, the registration fingerprint and collation 
fingerprint are collated again by the feature point 
method (step S713). Fig. 26 shows the collation 
process . 

10 In this case, when coarse collation and fine 

collation by the amplitude suppression correlation 
method are executed in steps S711 and 712 in Fig. 20, 
and it is confirmed that both collation results by 
coarse collation and fine collation by the amplitude 

15 suppression correlation method indicate "incoincidence 

( NG ) " , collation by the feature point method is executed 
in steps S713-1 to S713-10 corresponding to steps S313 
to S322 in Fig. 5. 

In collation by the feature point method, 

20 correction of the rotational shift and vertical and 
horizontal shifts of the collation fingerprint image 
data I on the basis of the vertical and horizontal shift 
amounts Ax and Ay obtained in the second collation and 
the rotational shift amount A 9 obtained in the first 

25 collation is done in step S713-5. The correction of the 
rotational shift and vertical and horizontal shifts may 
be executed not for the collation fingerprint image data 
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I but for the registration fingerprint image data R. In 
addition, the correction of the rotational shift and 
vertical and horizontal shifts need not always be 
executed after step S713-4. For example, when the 
5 correction should be done for the registration 

fingerprint image data R, this process can be inserted 
after one of steps S713-1 to S713-8. 

When it is confirmed that the collation result 
by the feature point method indicates "coincidence (OK)" 

10 (YES in step S713-10), it is determined that the 

registration fingerprint and collation fingerprint 
"coincide (match)" (step S414). However, if the 
collation result by the feature point method also 
indicates "incoincidence (NG)" (NO in step S713-10), it 

15 is determined that the registration fingerprint and 

collation fingerprint "do not coincide (mismatch)" (step 
S425) . 

[Third Embodiment (Ninth Invention): Rotation- Invariant 
Amplitude Suppression Correlation Method (Amplitude 
20 Suppression + Adding Sign (±) of Phase to Amplitude) + 
Amplitude Suppression Correlation Method + Feature Point 
Method] 

In the second embodiment, in coarse collation, 
the coordinate system of the registration Fourier image 
25 data R pL and collation Fourier image data I which 

contain amplitude- suppressed amplitude components and 
phase components is transformed into a polar coordinate 
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system (step S709 and S710 in Fig. 20). 

In the third embodiment, for registration 
Fourier image data R pL and collation Fourier image data 
I pr which have undergone amplitude suppression 

F L "* *" 

5 processing, the signs of phases are added to the 

amplitudes, and only amplitude components (R ' and I DI ■ ) 

FL FL 

with signs are extracted. The coordinate system of R pL ' 
and I pL ' is transformed into a polar coordinate system. 
Fig. 27 shows the flow chart of this processing. 
10 Unlike the flow chart shown in Fig. 20, steps 

S713 and S714 are added in the third embodiment. For 
the registration Fourier image data R and collation 

"~ FL 

Fourier image data I pL which have undergone amplitude 
suppression processing, the signs of their phases are 

15 added to the amplitudes. Only the amplitude components 
( R pL 1 and I pL ' ) with signs are extracted. Then, the 
coordinate system is transformed into a polar coordinate 
system to obtain R pL ' and I 1 (steps S709 and S710). 

According to the third embodiment, for 

20 registration Fourier image data R p and collation Fourier 
image data I p , the signs of their phases are added to 
the amplitudes, and only the amplitude components with 
signs are extracted. With this arrangement, the 
influence of discontinuity of phases can be reduced. 

25 Hence, even when an error such as a positional shift 

between a registration pattern and a collation pattern 
is present, collation can accurately be executed. 
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[Fourth Embodiment (10th Invention): Rotation- Invariant 
Amplitude Suppression Correlation Method (Amplitude 
Suppression + Absence of Phase) + Amplitude Suppression 
Correlation Method + Feature Point Method] 
5 In the second embodiment , amplitude 

suppression processing is executed for the registration 
Fourier image data R p and collation Fourier image data 
I p . The coordinate system of the registration Fourier 
image data R p and collation Fourier image data I p which 

10 have undergone the amplitude suppression processing is 
transformed into a polar coordinate system. 

In the fourth embodiment, phase components are 
removed from registration Fourier image data R p and 
collation Fourier image data I p . Amplitude suppression 

15 processing is executed for registration Fourier image 
data R p ' and collation Fourier image data I p ' without 
phase components. The coordinate system of registration 
Fourier image data R pL ' and collation Fourier image data 
I ' that have undergone the amplitude suppression 

20 processing is transformed into a polar coordinate 
system. In the amplitude suppression processing, 
however, not the amplitude suppression processing for 
suppressing all amplitudes to 1 but log processing or 
root processing is executed. Fig. 28 shows the flow 

25 chart of this processing. 

Unlike the flow chart shown in Fig. 20, steps 
S715 and S716 are added in the fourth embodiment. Only 
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amplitude components are extracted (phase components are 
cut) from the registration Fourier image data R p and 
collation Fourier image data I p (steps S715 and S716). 
Amplitude suppression processing is executed for the 
5 registration Fourier image data R p ' and collation 

Fourier image data I p ' having no phase components (steps 
S707 and S708). The coordinate system of registration 
Fourier image data R„ 1 and collation Fourier image data 
I„ ' that have undergone the amplitude suppression 

10 processing is transformed into a polar coordinate system 
to obtain R pL ' and I pL ' (steps S709 and S710). 

According to the fourth embodiment, when the 
phase components are removed from the registration 
Fourier image data R p and collation Fourier image data 

15 I p , and amplitude suppression processing is executed for 
them, the influence of a change in illuminance becomes 
small. Even when the illuminance changes between the 
registration time and the collation time, accurate 
collation can be executed. In addition, the performance 

20 in obtaining the correlation peak by the amplitude 

suppression correlation method using polar coordinate 
transformation can be improved. More specifically, the 
continuity of pixels is poor in the phase and good in 
the amplitude. Hence, when the phase component is 

25 removed, the performance in obtaining the correlation 
peak by the amplitude suppression correlation method 
using polar coordinate transformation can be improved. 
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At this time, as shown in Fig. 29, correlation 
peaks PI and P2 appear on the correlation component 
area. This is because the amplitude spectrum is 
point - symmetrical . By executing mask processing, one of 
5 the correlation peaks PI and P2 is determined as a 
normal correlation peak that indicates a rotational 
shift amount A 6 including the rotational direction. 
The rotational shift amount A 9 is obtained from the 
determined correlation peak. For example, when the 

10 correlation peak PI is determined as a normal 

correlation peak, the rotational shift amount A 6 is 
obtained from the vertical position of the correlation 
peak PI in the area shown in Fig. 29. In this case, the 
upper limit position in the vertical direction in the 

15 area is A 0 = +180°, and the lower limit position is A 

e = -i8o°. 

In the first to fourth embodiments described 
above, two-dimensional pattern collation such as 
fingerprint collation has been described. However, the 

20 present invention can also be applied to collation of an 
N-dimensional pattern including a one -dimensional 
pattern such as voice and a three-dimensional pattern 
such as a stereoscopic image. 

According to the present invention, the first 

25 collation means collates a registration pattern with a 
collation pattern by the correlation method, the second 
collation means collates the registration pattern with 
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the collation pattern by the feature point method, and 
it is determined on the basis of at least one collation 
result that the registration pattern coincides with the 
collation pattern. According to the present invention, 
5 when at least one of a collation result by the first 
collation means for executing collation by the 
correlation method and a collation result by the second 
collation means for executing collation by the feature 
point method indicates coincidence between the 

10 registration pattern and the collation pattern, it is 

determined that the registration pattern coincides with 
the collation pattern. Since the collation methods of 
different types, i.e., the correlation method and 
feature point method are combined, their disadvantages 

15 can be compensated for, and the collation accuracy can 
be made much higher than an apparatus which executes a 
single method. 

According to the present invention, when the 
collation result by the first collation means for 

20 executing collation by using the correlation method 

indicates coincidence between the registration pattern 
and the collation pattern, it is determined that the 
registration pattern Coincides with the collation 
pattern without executing collation by the second 

25 collation means for executing collation by using the 
feature point method. When the amplitude suppression 
correlation method having a higher collation accuracy 
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than that of the feature point method is used as the 
correlation method, the collation determination result 
can quickly be obtained. In addition, even when the 
collation pattern is a pattern that cannot be correctly 
5 collated by the correlation method, it can correctly be 
collated by the feature point method. Hence, the 
collation accuracy increases. 

According to the present invention, when the 
collation result by the second collation means for 

10 executing collation by using the feature point method 
indicates coincidence between the registration pattern 
and the collation pattern, it is determined that the 
registration pattern coincides with the collation 
pattern without executing collation by the first 

15 collation means for executing collation by using the 

correlation method. When the attribute of the pattern 
to be collated is suitable for the feature point method 
(for example, when the feature points are clear, the 
pattern is resistant to disturbance, or the pattern does 

20 not deform), or 1-to-N collation (a method of collating 
one collation pattern with N registration patterns) 
should be executed, the arithmetic amount for collation 
can be small. For this reason, the collation accuracy 
increases, and the collation result can be obtained in a 

2 5 short time. 

According to the present invention, an 
execution order designation means for allowing 
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designation of the execution order of collation by the 
correlation method and collation by the feature point 
method is arranged. When the compatibility between the 
two collation methods and the attribute of the pattern 
5 to be collated is known in advance, designation can be 
done to execute collation first by using the more 
compatible method, and the collation determination 
result can quickly be obtained. Even when the collation 
pattern is a pattern that cannot be correctly collated 

10 by the method executed first, it can correctly be 

collated by the method to be executed next. Hence, the 
collation accuracy increases. 

According to the present invention, the image 
of the collation pattern is inspected, and it is decided 

15 on the basis of the inspection result whether collation 
by the correlation method is to be executed first or 
collation by the feature point method is to be executed 
first. When the collation pattern has a small area or a 
high image quality, collation by the feature point 

20 method is executed first. In this way, collation by a 
collation method suitable for each collation pattern is 
preferentially executed. With this arrangement, both 
the collation accuracy and the collation speed can be 
increased. 

25 According to the present invention, when no 

collation result indicating coincidence is obtained by 
first collation, the rotational shift amount (A0) 
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between the two image data is obtained from the position 
of the correlation peak obtained in the collation 
process of the first collation. On the basis of the 
obtained rotational shift amount ( A 0 ) , rotation shift 
5 correction is performed for one of the registration 

pattern and collation pattern. Then, the registration 
pattern and collation pattern are collated again by the 
amplitude suppression correlation method (second 
collation). When no collation result indicating 

10 coincidence is obtained by the second collation, the 
vertical and horizontal shift amounts (Ax and Ay) 
between the two image data are obtained from the 
position of the correlation peak obtained in the 
collation process of the second collation. On the basis 

15 of the obtained vertical and horizontal shift amounts 
(Ax and Ay) and the rotational shift amount (A0) 
obtained from the position of the correlation peak 
obtained in the collation process of the first 
collation, rotation shift correction and 

20 vertical/horizontal shift correction are performed for 
one of the registration pattern and collation pattern. 
Then, the registration pattern and collation pattern are 
collated by the feature point method (third collation). 
Even when the registration pattern and collation pattern 

25 have a rotational shift or vertical and horizontal 
shifts, collation can accurately be executed. 

When the third collation is to be executed. 
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the rotational shift and vertical and horizontal shifts 
have already been obtained in the collation processes of 
the first and second collations. The rotational shift 
and vertical and horizontal shifts can be corrected on 
5 the basis of these pieces of information. Hence, 
collation by the third collation can quickly be 
executed. 

According to the present invention, for 
registration Fourier N-dimensional pattern data and 

10 collation Fourier N-dimensional pattern data which have 
undergone amplitude suppression processing, the signs of 
phases are added to the amplitudes , and only the 
amplitude components with signs are extracted. Then, 
the coordinate system is transformed into a polar 

15 coordinate system. With this arrangement, the influence 
of discontinuity of phases can be reduced. Hence, even 
when an error such as a positional shift exists between 
the registration pattern and the collation pattern, 
collation can accurately be executed. 

20 According to the present invention, phase 

components are removed from registration Fourier 
N-dimensional pattern data and collation Fourier 
N-dimensional pattern data. Then, amplitude suppression 
processing is executed for registration Fourier 

25 N-dimensional pattern data and collation Fourier 

N-dimensional pattern data. The coordinate system of 
registration Fourier N-dimensional pattern data and 
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collation Fourier N-dimensional pattern data that have 
undergone the amplitude suppression processing is 
transformed into a polar coordinate system. With this 
arrangement, the influence of a change in illuminance 
5 becomes small. Even when the illuminance changes 

between the registration time and the collation time, 
accurate collation can be executed. In addition, the 
performance in obtaining the correlation peak by the 
amplitude suppression correlation method using polar 
10 coordinate transformation can be improved. 
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